Goto

Collaborating Authors

 implement hierarchical information retrieval efficiently


Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently

Neural Information Processing Systems

Experimental data has revealed that in addition to feedforward connections, there exist abundant feedback connections in a neural pathway. Although the importance of feedback in neural information processing has been widely recognized in the field, the detailed mechanism of how it works remains largely unknown. Here, we investigate the role of feedback in hierarchical information retrieval. Specifically, we consider a hierarchical network storing the hierarchical categorical information of objects, and information retrieval goes from rough to fine, aided by dynamical push-pull feedback from higher to lower layers. We elucidate that the push (positive) and pull (negative) feedbacks suppress the interferences due to neural correlations between different and the same categories, respectively, and their joint effect improves retrieval performance significantly. Our model agrees with the push-pull phenomenon observed in neural data and sheds light on our understanding of the role of feedback in neural information processing.


Reviews: Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently

Neural Information Processing Systems

Update: I apologize for my confusion about the dynamics. I feel more positively now about this work, and have increased my score. There are two issues here to be addressed: a) how realistic is it for the dynamics of the feedforward pass recurrence within layers to run to convergence *before* sending down the top-down feedback? What happens if these are concurrent processes, such that units get both bottom-up and top-down inputs at the same time? Given the time-scale of the recurrent dynamics in cortex, the authors could then ask (in their model) whether this delay is "enough" for their push-pull mechanism to work. If yes, that would strengthen the result a fair bit.


Reviews: Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently

Neural Information Processing Systems

The manuscript studies the role of feedback connections in pattern retrieval networks. This is done in a hierarchical Hopfield-type network. Then, different types of top-down feedback are investigated. All reviewers found the results interesting. Besides its relevance to modelling of biology, it is also of potential interest for technical applications in hierarchical information retrieval.


Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently

Neural Information Processing Systems

Experimental data has revealed that in addition to feedforward connections, there exist abundant feedback connections in a neural pathway. Although the importance of feedback in neural information processing has been widely recognized in the field, the detailed mechanism of how it works remains largely unknown. Here, we investigate the role of feedback in hierarchical information retrieval. Specifically, we consider a hierarchical network storing the hierarchical categorical information of objects, and information retrieval goes from rough to fine, aided by dynamical push-pull feedback from higher to lower layers. We elucidate that the push (positive) and pull (negative) feedbacks suppress the interferences due to neural correlations between different and the same categories, respectively, and their joint effect improves retrieval performance significantly.


Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently

Neural Information Processing Systems

Experimental data has revealed that in addition to feedforward connections, there exist abundant feedback connections in a neural pathway. Although the importance of feedback in neural information processing has been widely recognized in the field, the detailed mechanism of how it works remains largely unknown. Here, we investigate the role of feedback in hierarchical information retrieval. Specifically, we consider a hierarchical network storing the hierarchical categorical information of objects, and information retrieval goes from rough to fine, aided by dynamical push-pull feedback from higher to lower layers. We elucidate that the push (positive) and pull (negative) feedbacks suppress the interferences due to neural correlations between different and the same categories, respectively, and their joint effect improves retrieval performance significantly.